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NONLINEAR  SEMIGROUP  FOR  CONTROLLED 


PARTIALLY  OBSERVED  DIFFUSIONS 


Wendell  H.  Fleming 


1.  Introduction.  In  this  paper  we  are  concerned  with 
stochastic  control  problems  of  the  following  kind.  Let  X 
denote  the  state  of  a  process  being  controlled,  Y  the  observation 
process,  and  U  the  control  process,  t  >  0.  The  state  and 
observation  processes  are  governed  by  stochastic  differential 
equations 

(a)  dXt  =  b(Xt,Ut)dt  +  a(Xt)dWt 

(1.1) 

(b)  dYt  =  h(Xt)dt  +  dWt. 

N  M 

has  values  in  N-dimensional  1R  ,Yt  values  in  IR  ,  and  U^ 

values  in  ^  clRL.  XQ  has  given  distribution  u,  and  YQ  =  0. 

In  (1.1),  W  and  W  are  independent  standard  Wiener  processes, 

with  values  in  IR^jlR^  respectively.  The  problem  is  to  find  an 

admissible  control  minimizing  some  criterion  J. 

For  instance,  we  may  take  J  =  EG(X.  )  for  some  fixed  time 

Z1 

tj  >  0.  In  case  of  completely  observed,  controlled  diffusions 
(with  Yt  =  Xt  rather  than  Yt  as  in  (1.1b)),  the  problem  can 
be  treated  using  dynamic  programming.  Let  V(x,t^)  denote  the 
minimum  of  J,  for  initial  data  Xq  *  x.  Under  suitable  asssumptions 
V(x,t)  has  continuous  partial  derivatves 


I 


...  .  wjjfe 
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The  assumption  that  a(x)  has  a  bounded  inverse  can  sometimes  be 
weakened,  by  considering  generalized  solutions  to  the  dynamic  pro¬ 
gramming  equation  [4,  p.  177]. 

In  [6]  Nisio  introduced  another  treatment  which  is  valid  under 

much  less  restrictive  conditions.  Let  -^G(x)  =  V(x,t).  Then 

Nisio  showed  that  5/^  is  a  nonlinear  semigroup  on  the  space 

C^OrN)  of  continuous  bounded  functions  f  on  ]R^.  Moreover,  the 

operator  L  in  (1.3)  agrees  with  the  generator  of  the  semigroup 

2  N 

on  the  space  C.  QR  )  of  those  f  such  that  f,f  ,f  are  in 

°  xi  xixj 

N 

C^QR  )  for  i,  j  =  1,...,N.  For  another  treatment  of  this  nonlinear 
semigroup  see  [1,  Chap.  IV. 5.1]. 

In  this  paper,  we  find  a  nonlinear  semigroup  associated 

with  the  partially  observed  control  problem.  In  this  case,  one 
should  regard  as  the  true  "state"  the  conditional  distribution  of 
Xt  given  past  data,  or  some  quantity  equivalent  to  the  conditional 
distribution.  For  technical  reasons,  it  is  more  convenient  to 
consider  an  unnormalized  conditional  distribution  for  X^. 


I 


We  have  A  €  JC,  where  Jt  is  the  space  of  finite  measures  on  1RN. 

The  problem  we  consider  is  to  control  the  measure-valued  process 

A  such  that  a  criterion  of  the  form  J  =  E4>  (A  )  is  minimized. 

Z1 

The  dynamics  of  the  A^-process  are  governed  by  the  Zakai  equation, 
written  in  a  weak  form  as  (3.1)  below. 

If  one  writes  VCp.t^)  for  the  minimum  of  J,  given  initial 
data  Aq  =  m ,  then  V(p,t)  formally  satisfies  a  dynamic  programming 
equation  of  the  form  - 

(1.4)  §|  =  <SV, 

where  =  min  i/uV  and  i^u  is  the  generator  of  the  linear 

ue^ 

semigroup  associated  for  a  constant  control  u  with  the 

process  A^  (for  constant  u,  At  is  Markov).  Equation  (1.4) 
is  called  Mortensen's  equation.  However,  (1.4)  has  been  treated 
rigorously  only  in  very  special  cases. 

Following  Nisio,  we  write  V(u,t)  =  _^<Hm).  The  purpose  of 

this  paper  is  to  show  that  is  a  nonlinear  semigroup,  on  a  space 

C {Jt) ,  with  ^<t>  continuous  in  t,  and  to  describe  the  generator 
y  on  a  dense  subspace  of  C (jt).  We  rely  heavily  on  results  from 
[3].  In  particular,  it  was  shown  in  [3]  that  At  can  be  defined 
pathwise,  in  such  a  way  that  A^  depends  continuously  on  observa¬ 
tion  and  control  trajectories  (Y,U)  and  on  u  =  AQ .  This  and 
other  results  from  [  3  ]  needed  in  this  paper  are  summarized  as 
3. 1-3. 4  below. 

For  the  case  of  a  controlled  Markov  chain  ,  subject  to 
observations  of  the  form  (1.1b)  a  corresponding  nonlinear 


V 


-'I- 


semigroup  was  constructed  by  Davis  [2]. 

2.  The  Spaces  C  (_i0 .  Let  CbQRN)  denote  the  space 

of  bounded,  continuous  f  on  1r\  and  Cq QR^)  the  space  of 

k  N  k  N 

continuous  f  with  compact  support.  Let  C^QR  ),  CgQR  )  be  the 
spaces  of  f  such  that  f  together  with  all  partial  derivatives  of 
orders  5  k  are  i-n  Cb(IR^),  CgOR^)  respectively.  Similarly,  for 
]Rm  valued  functions  on  ]RN  we  write  Cb  QRN  (lR111)  ,  CgQRN;lRm). 

Let  .0QRN)  denote  the  Borel  o-algebra  of  IR^,  and 

(2.1)  Jt  =  (measures P  >  0  on  itf(IRN)  :  P  QR^)  < 

We  write 


<f  ,P> 


dP  (x) 


for  the  scalar  product  and 


1 1 P 1 1  -  <1,p>  -  p  orn)  . 


By  convergence  of  sequences  in  J'  we  mean  w*-convergence : 

P  -*  p  if  and  only  if  <f,P  >  -*■  <f,P>  as  n  00  for  every 
f  e  CbQRN)  such  that  f(x)  ->0  as  |x|  -*•  °°. 

We  denote  real-valued  functions  on  JC  by  $,y,...  .  For 
K  =  0,1,2, .. .  let 


(2.2) 


11*11* 


SUP  Jj.frJ.i- 
ue.*  1* |  |n  1 1 K 
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By  <j>  continuous  on  A,  we  mean  of  course  continuity  of  <J>  under 
w* -sequential  convergence.  Let 

(2.3)  Ck(uT)  =  (4>  continuous  on  ^:||<t>||K  <  00 } . 

Then,  ||  ||K  is  a  norm  on  Let 

00 

(2.4)  cun  =  -  u  C„(_^). 

K=0  K 

For  r  <  °°,  let 

(2.5)  jar  =  (p  £  JL\  I  lull  <  r). 

We  give  C the  following  metric 

oo 

(2.6)  d(<M)  =  l  2"^  (sup  |<t>  (u)  -  YOOl  A  1). 

1-1  JL% 

Thus  d-convergence  of  4>n  to  $  is  equivalent  to  convergence  of 
<l)n(P)  to  <fr(p)  uniformly  on  JCr  for  every  r  <  00 .  For  each  K, 
||  ||K  is  a  lower  semicontinuous  function  under  d-convergence. 
Moreover,  from  (2.2),  <)>n,  $  £  C^(^)  and  |Kn-(l>||^  0  imply 

d  (4>  n  )  ->0  as  n  00 . 

Let 

Ji.  =  (P  >  0  on  #QRN) :  p(B)  <  «  for  every  compact  B) , 
with  the  vague  topology:  Pn  -►  p  vaguely  means  <f,Pn>  *  <f»W> 


-6- 


N 

as  n  -*■  00  for  every  f  £  Cq@R  a  Polish  space.  In  fact, 

one  can  choose  a  metric  <$(p,v)  for  Jt  of  the  form 

CO 

(2.7)  6(P,v)  =  l  2  *m(|  <f  ,M>  -  <f  ,v>|  a  1) 

m=l  m  m 

for  a  suitably  chosen  sequence  f  £  Cq0RN). 

For  each  r  <  00 ,  JC  is  a  compact  subset  of  .  For 
sequences  in  vague  convergence  is  equivalent  to  w* -convergence . 

Moreover  Pn,  p  £  Jt  and  Pn  ->  P  w*  imply  |  | u n |  |  <  r  for  some 
some  r.  Thus,  we  have: 

Lemma  2.1.  <P  is  continuous  on  JC,  under  w* -sequential 
convergence,  if  and  only  if  4>  |  JC '  is  vaguely  continuous  for  every 

r  <  °°. 

This  furnishes  an  alternate  characterization  of  C(^),  in 
terms  of  the  vague  topology  rather  than  in  terms  of  w*-sequntiei 
convergence . 

A  measure  P  €  Jt  can  be  approximated  by  measures  PP  with 
compact  support,  as  follows.  Let  P  £  CQ  QRN) ,  0  <  p  <  1,  and 
define  PP  by  <f,pp>  =  <pf,p>  for  all  f  e  QR^) .  Define  <PP 
by 

(2.8)  4>P(p)  =  4>  (PP)  ,  P  £  A. 

Then  <j>  £CK(uf)  implies  $P€CKC#)  and  ||<i>p||K<  ||<}>||K. 

We  write  p|B  for  the  restriction  of  p  to  a  compact  set 
B:  (p  j  B)  (A)  =  p  (A  fl  B)  for  all  A  €  _0QRN) .  Let 


I 


(2.9) 


C°(uf)  =  (<P  £  C^(.£):  there  exists  B  compact  such 
that  i|»(u)  =  •P  (M  |  B)  for  all  u  £  jt) . 

In  particular,  $ P  £  C^(_^)  if  <P  £  and  <P P  is  defined  by 

(2.8)  . 

Lemma  2.2.  For  every  <?>  £  C^(^)  there  exists  a  sequence 
^n  e  ^(.^O  such  that  |  I  ^  n  I  I  K  <  I  I  <H  I  K  an^  «U<l>n,<i>)  +  0  as 
n  ->  00  . 

Proof.  Let  P  £  Crt0R^)  with  0  <  P  <  1,  P  (x)  =  1  for 
-  n  0  -n-  n 

r'_ 

| x |  <  n  and  pn(x)  =  0  for  lxl  >  n  +  1*  Let  4>n  =  <J>  •  Then 
I  I  ^  n  I  Ik  -  I  1^1  I K*  s^nce  $  (y)  =  <P(Pny)  it  suffices  to  show  that 
MpnU)  *  <Hm)  tends  to  0  uniformly  on  Jlx  for  every  r  <  00 . 
Let 


\  =  max  |Hpnu)  *  4,(y)|  =  |Mpnpn)  ’  *  (pn)  I 

Jtx 

for  some  yn  £  Jtx  (recall  that  jtx  is  compact).  We  have 

pn%  6  ^r*  For  each  £  e  <£»pnMn>  =  <f,Mn>  £or  a11 

large  enough  n.  Consider  any  subsequence  such  that  un  tends  to 

a  limit  y.  Then  P  y  also  tends  to  y  for  n  in  this  sub- 

n  n 

sequence.  Since  <j>  |  Jt  is  continuous,  both  MpnUn)  and  ♦  (Mn) 

tend  to  Mu).  If  lim  sup  n  >  0 ,  we  could  find  some  such 

n-*o  n 

subsequence  for  which  |<P(PnMn)  -  Mun)  |  tends  to  a  positive 
limit,  a  contradiction.  This  proves  Lemma  2.2. 


J 
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Lcmma  2.3.  Let  V  €  C^(^),  and  B  compact  such  that 
Hu)  =  ^  (U  |  B)  for  all  m  6  JC  .  Then  there  exists  a  sequence 
£  ck(-^)  such  that  ll^nllK  5  !KIIk»  dO^.H  0  as  n 


and 

=  0  whenever 

U(B)  >  n. 

Proof. 

Choose 

P  € 

C0(IRN)  with  0  <  P  <  1,  P  (x )  =  1 

for 

all 

x  €  B. 

Let  g 

fan 

€  co 

0R1),  with  0  <  gn  <  1,  gn(s)  =  1 

if 

s  < 

n  -  1, 

gn(s)  =  0 

if 

s  >  n.  Let 

«n(w)  -  g n(<P,u>)Hu). 

Since  |  «^n  CM )  |  <  |Hu)|>  ll^n!lK  <  ||1'|IK-  For  U  €  _^r , 

<P,F>  <  r.  Hence  ^n(d)  =  Hu)  if  n  >  r  +  1,  which  implies 
Yn  V  uniformly  on  Thus  d(^n,H  -»■  0  as  n  -*■  00 .  Finally, 

u (B)  >  n  implies  <P,u>  >  n,  and  hence  ^n(u)  =  This  proves 
Lemma  2.3. 


The  set  of  "test  functions".  In  §5  we  shall  define  a 
"generator"  for  the  nonlinear  semigroup  on  the  following  set  of 
functions  <P  ,  depending  on  finitely  many  scalar  products: 


(2.10)  <&  =  {(j>:  Hu)  =  F(<f1,u>, .  .  .  ,<fj,p>)  , 

f  e  c”0RJ),  ^....fj  e  c”qrn),  j  =  1,2,...}. 


In  §4,  we  shall  weaken  slightly  the  conditions  on  F,f^,...,fj,  to 
obtain  certain  sets  o#m  containing  3). 


'*■?  P" 


-  O  - 

Lemma  2.4.  For  every  4>  €  there  exists  a  sequence 

<V n  e  such  that  ll^nl!^  *'  II^IIk  +  n  1  and  dOn,<iO  -*•  0  as 
n  -*  °° . 


Proof.  By  Lemmas  2.2  ancl  2.3  it  suffices  to  suppose  that, 
in  addition,  there  exist  compact  B  and  a  >  0  such  that 
i>(u)  =  <Hh  |  B)  for  all  u  and  4>(u)  =0  if  u  (B)  >  a.  Following 
a  similar  construction  in  [5,  §3],  given  e  >  0,  we  take 
&!»•••, gj>  Xj,...,Xj  with  the  following  properties: 

gj  £  C"(1RN),  g..  >  0,  diam(spt  g^ )  <  ^ 

J  M  J 

l  g.U)  <  1  for  x  £  1R  ,  l  g-(x)  =  1,  x  e  B, 

j=l  3  j=l  3 

x .  e  B  n  spt  g . 


Let 


1R+  =  { z  €  IRJ:  z.  >  0  for  j  =  1 . J)  , 

J 

F(z)  =  H  I  z.S  ) 
j  =  l  3  j 

where  6^  denotes  the  Dirac  measure  at  x.  Then  F  £  Cq0R^). 
In  fact,  F(z)  =  0  whenever 


J 

l  z  t  (B)  - 
j-i  1  xi 


J 

I  z.  >  a. 
j=l  3 
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oo  J 

By  regularizing,  there  exists  F  €  CqQR  )  such  that 
|  F  (z)  -  F(z)  |  <  e  for  all  z  €  TR+.  Then 

»KM)  =  F(<glfU>, ... 

is  in  For  all  U, 

J 

| V  (U)  |  <  i<i>  (  l  <gi  ,F>«X  )  |  +  e 
j=l  J  j 


i  1 1*  11*0  *  IMIk)  * 


Therefore,  ||^IIK  <  | 1^1 1 K  +  e- 

We  take  £  =  ^  =  n-1,  and  corresponding  gjn>xjn»  j  = 

The  corresponding  obtained  from  the  construction  above  has  the 

properties  required  in  Lemma  2.4.  To  show  that  d(Vn,<}>)  0,  it 

suffices  to  show  that  <!>  (u)  -*•  4>(M)  uniformly  on  J?r  for  any 
r  >  0  as  n  °°.  Now 

l^nCvi)  -  4>[Gn(u)]l  < 

Gntu)  ■  j"  <<V‘>{*.  ' 

j=l  J  jn 

On  JCr,  both  vague  and  w* -convergence  of  a  sequence  are  equivalent 

to  convergence  in  the  metric  6  in  (2.7).  For  each  m, 

|<f  ,G  (p)>  -  <f  ,P  M> I  ->0  as  n  -*•  00  uniformly  for  u  €  Jt  , 

1  m’  nv  J  m’  n  1  r 


where  P  =  l  g.  .  Therefore,  6  (Gn  (u )  ,  P  u )  -*•  0  uniformly  on  J( 
n  j  3n  n  n  1 

as  n  ->■  °°.  Since  JCr  is  compact  and  <p  continuous  on 
is  uniformly  continuous  on  Thus,  |<t>[Gn(y)]  -  <t>(Pnw)|  -*■  0 

uniformly  on  JCx.  Since  Pn(x)  =  1  on  B»  =  4>(y)  =  $  (y  |  B) . 

This  proves  that  ^(u)  -*•  4>  (M )  uniformly  on  jfr,  as  required. 

3.  The  Control  Problem  for  A  .  We  begin  with  a  summary  of 
assumptions  and  notations,  together  with  a  review  of  concepts  from 
[3].  We  make  the  same  assumptions  as  in  [3]  about  the  coefficients 
in  (1.1): 

(Aj)  a  is  a  bounded,  Lipschitz  N  *  D  matrix- valued 
function  on  1RN. 

(Az)  b(x,u)  =  b°(x)  +  b^(x)u,  where  b^b1  are  bounded, 

N 

Lipschitz  functions  on  1R  . 

Note  that  b^1  has  values  in  1R^,  and  has  N  *  L  matrices 
values.  In  §5,  we  shall  impose  additional  smoothness  conditions 
on  cr,b^,b*. 

(A3)  h  £  C^0RN(1RM). 

(A4)  is  a  convex,  compact  subset  of  1RL. 

M 

We  use  Y  to  denote  an  ]R  -valued  function,  and  U  a 
“^-valued  function,  of  time  t  >  0.  Let  Yt'^t  denote  their 
respective  values  at  time  t.  Let 

n  -  ( (Y  ,U) :  Yq  =  0,  Y  £  C([0,»):  3RM) ,  U  €  L2  (  [0  ,T] ;  <20  for 


as 


for  each  T  <  »} . 
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Let  denote  the  set  of  restrictions  to  [0,T]  of  functions 

(Y,U)  £  Q .  As  in  [3],  we  give  a  metric  in  which  convergence 

of  a  sequence  (Yn>un)  means  uniform  convergence  on  [0,T]  of 
Y  and  weak  convergence  of  in  L^([0,T];  ‘20.  We  give  SI  a 

metric  in  which  convergence  of  (Y  ,Un)  is  equivalent  to  con¬ 
vergence  of  (Y  ,11^)  restricted  to  [0,T]  for  every  T  <  00 .  Let 

^.(Y)  =  -o{Ys,  0  <  s  <  t} 

9t(U)  =  o{Vs,  0  <  s  <  t}, 

=  ^(Y)  x  ^.(U). 

These  are  o-algebras  of  subsets  of  Q.  However,  if  t  <  T,  they 

can  also  be  regarded  as  o-algebras  of  subsets  of  In  [3] ,  ^ 

2  2 
was  denoted  by  SI  and  ^  by  $ ^ . 

Let  %  be  the  least  o-algebra  containing  for  all  t  >  0. 

CO  t 

Definition.  An  admissible  control  on  [ 0 , T]  is  a  probability 
measure  "T  on  (fiT,  ^T)  ,  such  that  Y  is  a  7rT,  {  -Wiener 
process  for  0  <  t  <  T. 

An  admissible  control  is  a  probability  measure  if  on  («, 
such  that  Y  is  a  " ,  {  j^J-Wiener  process  for  t  >  0. 

The  definition  of  admissible  control  on  [0,T]  is  exactly  as 
in  [3).  If  if  is  an  admissible  control,  then  its  restriction  nT 
to  is  admissible  on  [0,T]. 

Let  denote  the  set  of  all  admissible  controls 


vt  • 


.v6- 


I 


on  [0 ,T] . 
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Then  is  compact  under  weak  sequential  convergence  of 

probability  measures  [3,  Lemma  2.3].  Let  denote  the  set  of 

all  admissible  controls  with  the  weak  sequential  convergence 

topology.  Then  V  is  a  compact  metric  space  under  (for  instance) 

the  Prokhorov  metric.  Moreover,  n  •>  11  if  and  only  if  the 

n 

restrictions  77  t  tend  to  tt  as  n  00  for  each  T  finite, 
n  ,T  T 

The  unnormal izcd  conditional  distribution  measure  A  .  Lor 
every  u  £  Jt ,  (Y,U)  £  12,  and  t  >  0 ,  we  define  At  =  A^  by 
formula  [3,  (3.9)].  (In  [3]  we  wrote  A  ,  but  now  we  wish  to 
emphasize  its  dependence  on  the  initial  value  y  =  A„ . )  From  its 
definition,  A  £  and  A^  is  ^.-measurable  as  a  function  of 

(Y,U)  €  12.  In  [3, §3]  we  interpreted  A^  as  an  unnormalized 
conditional  distribution  of  Xt  in  (1.1a)  with  respect  to  the 
o-algebra  <0  generated  by  the  observation  and  control  past  up 
to  t.  The  normalized  conditional  distribution  of  is 

||At)|  A^.  The  intuitive  reason  for  conditioning  on  ,  rather 

than  on  _^(Y),  is  that  is  not  necessarily  j^.  (Y)  -measurable 

^-almost  surely,  when  71  G  S&.  For  the  smaller  class  of  strict- 
sense  admissible  controls  [3,  §6]  one  can  condition  on  5*  (Y) 
instead  of  . 

We  shall  need  the  following  properties  of  A^ ,  proved  in  [3]. 

YU 

3.1.  For  each  t  >  0,  r  <  ,  A^  is  continuous  on  JCx  *  12. 

See  [3 ,  Lemma  3.2]. 

3.2.  For  each  finite  T,r,a  there  exists  p  =  p(T,r,a)  such 

that  0  <  t  <  T,  | |y | |  <  r,  ||Y||y  <  a  imply  | ] ] |  <  p.  Here 

{ I Y | ( T  =  max  |Y(t)|.  See  [3,  (3.6)];  since  A  depends  linearly 
0<t<T  z 


-li¬ 


on  m  =  it  suffices  to  consider  ||m||  =  1. 

3.3.  The  Zakai  equation  holds: 

Ut  2  N 

(3.1)  d<f,At>  =  <1.  cf,At>dt  +  <hf,A  >-dY  ,  all  f  £  OR  )  . 

See  [3,  Thm.  5.2].  Here,  for  constant  control  u  £  °k  ,  LU  is 

N 

the  generator  of  the  diffusion  process  in  111  corresponding  to 
(1.1a): 

,  N  n  i 

(3.2)  Luf  =  i  l  a. . (x) f  ♦  (b  (x)  +  bA(x)u)-Vf 

i,j  =  l  J  i  j 

with  a  =  oo' . 


3.4.  For  every  T  <  «,  K 

that 


1,2,...,  there  exists  y 

k  1 


such 


for  all  77  €  S&.  See  [3,  Thm.  5.3]  with  m  =  0. 

For  t  >  0,  u  £  A  71  £  sf,  <)>  6  C (jt)  let 

VII 

(3.3)  J(t,u,7T,4>)  -  E^CAJJJ). 

Since  <P  €  for  some  K,  the  expectation  exists  by  3.1  and 

3.4. 


- 1  r>  - 

Lemma  3.5.  Let  ||4>n||K  1  (:  and  d(?n,<J>)  ->0  £s  n  -*•  «. 

Then 


J(t,u,*.<P)  =  lim  ) 

uniformly  on  [  0  ,  T  ]  *  Jt  x  ja/,  for  any  finite  T ,  r . 

Proof.  Consider.  Ten,  and  let  ILj.  c;  $2^  denote  the  set  of 
restrictions  to  [0,T]  of  (Y,U)  £  T.  Then 


(*) 


IWV  •  VCAt)l  ; 


< 


IVV  -  4>(At)|dTT  ♦ 


|fl>n(At)  -  HAt)|dn 


with  r '  *  si  -  T.  If  rT  is  a  compact  subset  of  then  |  |Y|  |^. 

is  bounded  on  r.  By  3.2,  0  <  t  <  T,  (Y,U)  £  r,  u  £  imply 

At  £  for  some  P.  Since  d(4>n,4>)  -*■  0,  <P  uniformly  on 

Jlp.  Therefore,  the  first  term  on  the  right  side  of  (*)  tends 
to  0  as  n  -*  °°,  uniformly  with  respect  to  (t,u,^)  £  [0,T]  x  Jlx 
It  remains  to  show  that,  given  e  >  0,  f  can  be  chosen  such 
that  the  last  term  in  (*)  is  less  than  t,  uniformly  on  [0,T]  * 
JKr  *  Now 


l%(At)  -  4*(At)  |  <  (|  !♦„!  |  K  +  |  |<t>|  lK)(l  ♦  l|AtMK) 

<  2C (1  +  ||Atl|K). 


*  Si/. 


By  Cauchy-Schwartz  and  3.4 
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1  1 
f  |  |AJ  |Kd*  <  nr'}2(f  i  !A  |  |2Kd*)2 

;  p i  z  ~  Jr<  1 

1  1 

<  1I(r')2Y2K,Tl  M  lK- 

Under  (Y,U)  -*■  Y,  n  projects  onto  Wiener  measure  w.  Let 
A  c  C([0,T]dRN)  be  compact  with  Yg  =  0  for  all  Y  £  A  and 

1 

w[C([0,T]  dRN)  -  A]  <  £2 [ 2C (1  +  YfK,TrK) ) ~  • 

We  choose  r  such  that  =  A  x  L2  ( [0  ,T]  ;  .  Since 

L2([0,T];^)  is  compact  (weak  topology),  rT  is  compact.  We 
have 

1  1 

/r,IW  '  +  1T(r')7Y2K,TrK)  < 

as  required.  This  proves  Lemma  3.5. 

Lemma  3.6.  For  each  t  >  0,  4>  £  C  {J( )  ,  r  <  00 ,  vJ(t,M,7T,'l>) 

is  continuous  on  *  s/  . 

-  r 

Proof.  Let  g(y,Y,U)  =  MaI’0).  By  3.1,  3.2,  g  is  continuous 

t ,  y 

on  Jtr  *  a  (recall  that  (Yn,Un)  (Y,U)  implies  llYn-Yllt  ♦  °» 
and  hence  MYnllt  5  a  for  some  aO  Moreover,  g(y,*,-)  is 
%  ^ -measurable . 

Suppose  first  that  <^(p)  is  bounded  on  J( .  Let  un  ->  y , 

tt  -*•  it  with  y  e  JC  .  By  definition  of  weak  convergence 
n  nr 
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lim  [  g (p , Y ,U)  d11  =  f  g(p,Y,U)dn. 

'  n  J  n 

Moreover,  |g(u  ,Y,U)  -  g  (u  ,  Y ,  U )  |  +  0  as  n  “,  uniformly  on 
any  r  c  Q  such  that  the  set  r  of  restrictions  to  [0,t]  of 
(Y,U)  €  T  is  compact.  As  in  the  proof  of  Lemma  3.5,  we  can  choose 
T  such  that  n  (J2-T)  is  arbitrarily  small,  uniformly  with 
respect  to  n.  This  proves  Lemma  3.6  in  case  <?>  (p )  is  bounded  on  J( . 

Now  take  any  0  €  C'K(^f )  .  By  Lemmas  2.2  and  2.3,  there  exist 

9  £  Cv(jt)  such  that  |<P  (u )  |  is  bounded  on  J!  for  each  n, 

n  K  n 

j|0  ||K  is  bounded,  and  d(0n,<?)  ->0  as  n  Lemma  3.6  now 

follows  from  Lemma  3.5. 

The  control  problem.  Given  t,p,0,  we  consider  the  problem 
of  minimizing  J(t,p,Ti,p)  =  F.^0  (At)  on  the  space  .W  of  admissible 
controls  n .  We  can  regard  the  Zakai  equation  (3.1)  as  governing 
the  dynamics  of  the  "state"  process  At  for  this  control  problem. 

Since  A^.  is  an  unnormalized  conditional  distribution  measure  for 
in  the  partially-observed  control  system  (1.1),  we  call  the 
problem  of  minimizing  E.^0  (A^.)  a  "separated"  optimal  control 
problem. 

Following  Nisio  [6]  let 

(3.4)  ^L'Ku)  =  min  J(t,p,H,0)  . 

ire  srf 


The  minimum  is  attained,  by  Lemma  3.6. 
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Since  ( A  ^_ )  is  ^-measurable,  the  minimum  is  the  same  taken 

in  the  class  srf  of  admissible  controls  on  [ 0  , t ]  : 

(3.5)  v  *  (u )  =  min  J  (t  ,u  , 71  ,<P ) 

1  77  £  erf  z 

t  t 

Tor  the  special  case  4>  (m )  =  <G,y>  ,  J  =  Eir<G,At>  which  is 
of  the  form  considered  in  the  existence  theorem  [  3  ,  Theorem  4.1]. 
However,  if  *  has  this  special  linear  form,  is  not 

not  linear  in  w.  Hence,  we  define  the  bigger  space  , 

and  not  merely  on  the  space  of  *  of  the  form  ')’(u)  =  <G,p>. 

Theorem  5.1.  <P  £  implies 

Proof.  By  Lemma  3.6  and  the  fact  that  and  srf  are 

compact,  ||u  ||  <  r  and  u  -»•  y  imply  j/.*  (p  )  -*■  rfP  (U )  .  Since 

11  I L  L  11  L 

any  w*-convergent  sequence  Pn  has  NunN  bounded,  y^P  is 
continuous  on  Jt.  From  3.4, 

|J(t,M,®,*)|  5  |  |t|  |K  E  |  (1  +  |  |  At  |  |K)dit 

5  IMIKn+YKt||M||K) 

5  a+YKt)ll*llKa+l|p||K). 

Thus,  ||  y.4>  |  |  v  <  ( 1  +■  Y  )  |  |*  |  |  v,  which  proves  Theorem  3.1. 

t  K  K  t  In. 

In  the  next  section  we  establish  the  semigroup  property  of 

V 


4.  The  Semigroup  P roperty.  The  purpose  of  this  section  is 


to  prove  the  following  two  theorems. 


Theorem  4.1.  For  every  <}>  £  C(_/),  s,  t  >  0, 


w  •  ^s-V- 

Theorems  3.1  and  4.1  imply  that  .5?  is  a  (.nonlinear)  semi¬ 
group  on  Let  denote  the  space  of  bounded 

continuous  functions  on  JC  (it  is  the  same  as  when  K  = 

From  (3.3),  (3.4)  ||  _^<! >  -  |  |  Q  <  |  [4> -V  |  |  Q  .  Hence,  when 

restricted  to  ^  is  a  contracting  semigroup  on  . 

Theorem  4.2.  For  every  is  a  continuous 

function  of  t  £  [0,°°)  in  the  d-metric  on  . 

The  proof  of  Theorem  4.1  will  be  based  on  a  series  of  three 
lemmas.  We  begin  by  temporarily  imposing  rather  stringent 
conditions  on  the  coefficients  in  (1.1),  and  on  Y,U,u .  We  say 
that  the  coefficients  are  regular  if  o,b^,b^,g  are  of  class 

QRN dR£ )  for  the  appropriate  £  =  ND,N,NL,M,  respectively. 

12  N 

Let  us  denote  by  C  ’  the  class  of  functions  q  on  [0,®)  *  1R 

with  the  following  properties: 

(i)  q  and  the  partial  derivatives  q.,qv  ,q  are 

t  Xi,  xLx. 

continuous,  i,j  =  1,...,N. 

(ii)  For  each  T  >  Q,  there  exist  C,k  >  0  (depending 


perhaps  on  T)  such  that 
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| r (x,t)  |  <  C  exp ( -  k  |  x  | )  ,  0  <  t  <  T, 

where  r  denotes  any  of  the  functions  q,q  ,qv  v  • 

xi  xixj 

For  brevity,  we  write  q(t)  =  q(t,0- 

Lemma  4.1.  Assume  that  the  coefficients  in  (1.1)  are  regular, 
and  that  Y  G  C1  ( [0  ,«)  ;1RN)  ,  U  G  C((0,»);  °ii)  .  Then: 

(a)  Lf  m  has  a  density  p^  G  (lR^)  ,  then  At(  =  A^JU)  has 

12  . 
a  density  q  G  Ce  *  ,  satisfying  the  partial  differential  equation 

,  U.  *  17 

(4.1)  $  =  (L  *)  q  +  hq.Yt  -  \  | h | Zq ,  t  >  0 

q(o)  =  p0- 

(b)  I_f  q  G  C^’2  is  a  solution  of  (4.1)  with  q(0)  the 
density  of  p,  then  q(t)  is  the  density  of  At  for  all  t  >  0. 

Here  (Lu)  denotes  the  formal  adjoint  of  the  operator  Lu  in 

(3.2) ,  and  =  dY/dt.  Note  that  part  (a)  of  the  Lemma,  but  not 

part  (b) ,  requires  that  q(0)  has  compact  support. 

Proof  of  Lemma  4.1.  To  prove  (a),  we  recall  from  [3,  §5]  that 

(4.2)  p(t)  =  q(t)exp(-Yt*h) 

1  2 

is  a  solution  in  C  ’  to  the  partial  differential  equation 


‘■■Mm. 
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(4.3) 


jjjr  =  L*p  +  c(t)p,  where 
Lt  =  Lt  -  (aYt-Vh,V),  Lt  =  L 


e  (t)  -  i  (aYt-Vh,Yt-Vh)  -  Y^h  -  ±  |  h  |  2 


where  (a5,n) 
The  operators 


N 

I  a  .  .  n  ■  and 

i,  j=i  1J  1  J 

L*,^*  are  related  by 


denotes  the 


product  in 


(4.4)  (L*p)exp(Yt*h)  =  L*q  -  eq  -  j  |h|"q. 


Equation  (4.4)  follows  upon  multiplying  both  sides  of  (4.4)  by 
f  €  C0QRN),  integrating  by  parts,  and  using  the  relation 

exp(Yt*h)Ltf  =  Lt [ £  exp(Yt*h)]  +  e(t)f  exp(Yt-h) 

+  j  |h|2f  exp(Yt-h). 


Then  equation  (4.1)  follows  from  (4.3),  (4.4)  and  the  product  rule 

applied  to  ^  [p  exp(Yt-h)]. 

1  2 

To  prove  (b) ,  if  q  £  C  '  satisfies  (4.1),  then  the  above 

calculation  shows  that  p ( t )  defined  by  (4.2)  is  a  solution  in 

C*’2  to  (4.3).  It  follows  from  [3,  (5.5)]  that  q(t)  is  the  density 

of  A  .  (In  the  derivation  of  [  3  ,  (5.5)]  it  was  stated  that 
N 

q(0)  €  C0QR  ).  However,  the  proof  there  is  based  on  integrations 

1  2 

by  parts,  and  is  the  same  if  q  £  Cg ’  . )  This  proves  Lemma  4.1. 


For  s  >  0,  let  us  introduce  the  notation 


-21- 


Y  =  Y 
x  s  +  x 


u; 


s  +  x  ’ 


x  >  0. 


In  particular,  Yq  =  0;  and  (Y,U)  £  ft  implies  (YS,US)  £  ft. 


Lemma  4.2.  For  every  (Y,U)  £  ft,  m  £  J( ,  s,  t  >  0, 


(4.5) 


YU  =  .  YSUS 
s  +  t  ,M  AtA 


s 


where  A 
-  s 


Proof.  Step  1.  First  assume  the  conditions  of  Lemma  4.1 

a  °o  n 

on  b  ,o,h,Y,U,  and  that  u  =  AQ  has  a  density  pQ  £  C Q  OR  ). 

1  2 

By  Lemma  4.1(a),  Ax  has  a  density  q(x)  £  C  '  satisfying  (4.1) 

for  x  >  0 .  Let  qS(T)  =  q(s+x).  Then  qS  is  a  solution  in  C1 ’ 

of  (4.1),  with  (Y,U)  replaced  by  (YS,US);  note  that 

Ys+t  =  Yx  and  qS(0)  =  q(s).  By  Lemma  4.1(b),  qS(t)  is  the 
Yslls 

density  of  A .  This  proves  (4.5)  under  these  conditions. 


I 

Step  2.  Again  assume  regular  coefficients  b  ,o,h,  l  =  0,1. 

Let  (Y,U)  £  ft,  u  £  .  Let  (Yn,Un)  -  (Y,U),  Pn  -  M ,  where 

Y  ,U  ,M  satisfy  the  conditions  in  Step  1  for  each  n.  Write 
n  n  n  1  * 

Y  U 

An  =  Cu  n.  By  property  3.1,  as  n  -*■  00 
s 


Y  U 
^  n  n 

s  +  t,p 


n 


A 


YU 

s  +  t,p’ 


YSUS 
^  n  n 

t  An 


YSUS 
t  A_ 


At  the  last  step  we  used  the  fact  that  (YS,US) 
1  n  n 


(YS,US).  This 


implies  (4.5). 
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Step  3.  Fix  U  €  J ,  (Y,U)  £  U.  Let  Jn-h^>hn  K‘  >'eFular  for 
each  n,  uniformly  bounded  together  with  their  lirst  order  partial 

z 

derivatives  and  tending  uniformly  to  o,b  ,h  as  n  -+  <x>,  l  -  0,1. 

Write  =  A1^1*  to  indicate  that  the  coefficients  depend  on  n. 

The  proof  of  [3,  Theorem  5.1]  shows  the  following:  -*■  v, 

v  £  j(  ,  implies  A“v  ATV  for  any  t  >  0 .  We  then  have  as 
nr  n 

n  -*■  00 


A  -*■  A  ,  A  -*  A 

s  +  t  ,U  s+t,U  SM  sm 

Similarly,  if  we  write  A^  =  A^ ,  then 

•nVsut  ,YSUS 

t*“  tAs  ' 
s 

This  implies  (4.5),  and  hence  Lemma  4.2. 

As  in  §3  let  tt  denote  the  restriction  to  &  of  n  £ 
s  s 

Yl  i  t  .S  S 

Let  be  a  regular  conditional  distribution  for  (Y  ,U  j 

given  . 


Lemma  4.3.  I f  n 

(a)  ir*u  e  rrs 

(b)  J(s  +  t  ,u  ,-n  ,<f  ) 


£  then: 


-almost  surely; 


SI 


J(s,AYU,^YU 

SM  S 


♦)dus, 


for  any  <p  £  C(jt) . 
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Proof.  To  prove  (a)  it  suffices  to  verify  that,  for  any 
.^-measurable  $  €  ^.-measurable  T  £  I:  €  C^ilR^), 

and  r  >  t 

E7[[4'CY,U)$(YS,US)F(Y^-Y^)]  =  07I[f(Y,U)$(YS,US)]E7[F(Y^-Y^). 

But  this  follows  from  independence  under  ti  of  the  random 
variables  T (Y ,U) 4>  (Y^U5)  and  F(Y*-Y*). 

Part  (b)  is  immediate  from  (3.3),  Lemma  4.2  and  properties  of 
conditional  expectations. 

Proof  of  Theorem  4.1.  For  every  11  €  ja/,  Lemma  4.3,  the 
definition  (3.4)  of  ,  and  (3.5)  imply 

JCsn.u.M)  ■  (  t)J>s 

i  Ja  >t*(A™)d»s= 

>  rs  j/t$  (u ) . 

Since  this  is  true  for  every  it  e 

ys+t<p  oo  >  j?s  oo . 

To  prove  the  opposite  inequality,  we  make  the  following 

construction.  Let  P  >  0,  6  >  0  to  be  chosen  later.  Let 

A„  =  A  -  A  and  A.  , .  .  .  ,A  disjoint  Borel  subsets  of 
u  h  i  r  m  P 


f  V  i 
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such  that 


and  for  v,  v  €  At ,  i  =  l,...,m,  n  £  si, 

I  J(t,v,7r,$)  -  J(t,v'  ,*,♦)  |  <  6. 

This  is  possible  by  Lemma  3.6.  Choose  y^  £  and  71  ■  £  _&  such 
that 


J(t,Mi,Tr.  ,$)  <  _5^(j>  fy i)  +  6. 


For  all  v  £  f 


(*) 


J(t,v, *._,*)  <  >t<PO)  +  36. 


Let  tTq  €  srf  be  arbitrary.  Let 


-  w.  if  A™e  a.. 
si  sy  i 


Given  "s  €  j*' ,  this  defines  n  £  such  that  tt^u  is  a  regular 

conditional  distribution  for  YS,US  given  $  and  irl  =  tt 

s  1  s  s* 

By  Lemma  4.3  and  (*),  with  v  =  A^U  =  a 

sy  s 


J(S  +  t,M,TT,<j>)  = 


J(S,A  ,7r^u  4> ) dTT 


5  I  ^(As)dTTs  +  |  J(s,As,Ti0,<{.)diTs  +  36. 

n  *  Art  ^ 


/ 

A 
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Since  _?s+t4>  (y )  <  J(s+t  ,y  ,it  ,<j> ) ,  we  have 

-^  +  t4>00  <  jr^(As)  +  f  J(s,As,ir0,<j.)d7rs 
s  A0 

+  f  CAs^d7Is  +  3S- 
A0 

Now  <P  €  C^(_^f)  for  some  K.  We  have,  for  some  , 

|J(s,As,n0^)|  <  Cj  (1  +  |  |  As  |  I  K) 

i  5  ci(1  +  !IasMK)> 

while  by  3.4  and  the  fact  that  A0  =  {v.‘  |  |  v|  j  >  p} 

I  a  *  l|As!|K)a"s  5  p'K£,  [|MsI|K  *  ||asHzk] 

Aq  S 

<  C2p‘K(1  ♦  r2K) 

for  p  €  Therefore,  given  e  >  0  we  can  choose  p  large 

enough  and  6  small  enough  that 

i£+t*0O  5  Ett  ^(Ag)  +  e, 
s 

for  all  u  €  and  TTg  e  .  Upon  taking  the  inf  over  ns 

(recall  (3.5)) 


ttghiii'i  ir-  ” 

i 


>  rJ&i 
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+  5  ys  >t<KM)  +  e- 

Since  e  is  arbitrary,  we  obtain  Theorem  4.1. 

In  preparation  for  the  proof  of  Theorem  4.2,  and  for  §5,  let 
us  introduce  the  following  family  of  operators  i^u,  for  constant 
controls  u  £  °2t  .  Let 

=  {$:  $(m)  =  F(<f1  ,p>, . . .  ,<fj,p>) , 

F  e  c20Rj),  fi.---.fj  e  c*orj),  j  =  1,2,...}, 
and  for  each  integer  m  >  0 

(4.6)  =  (4>  £  £:  |Fz  (z)  |  <  C(l+  |  z  [m+1)  ,  |Fz  z  (z)| 

j  j  ^ 

<  C (1+ | z | m) ,  j,  k  =  1 . J}. 

We  have  the  inclusions  ^  c  c  ’ 

For  <P  €  and  u  £  ,  let 

J 

(4.7)  ^U<j>(u)  =  l  F  ( .  .  . )  <LUf .  ,p> 

j=l  Zj  J 

J 

+  Z  Fz  z  C  -  *  .)<h£  -  ,vi>*<hfk.M> 
j,k=l  j  k  J 

where  ...  denotes  that  the  partial  derivatives  F  ,F  are 

J  J  k 

evaluated  at  the  vector  z  =  (<f^ ,y> , . . . ,<f j,h>) •  It  might  seem 
that  Jfu<P  depends  not  just  on  <t> ,  but  also  on  F,  f^,...,fj. 
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ilowever,  it  follows  from  (4.13)  below  that  this  difficulty  does 
not  occur. 


Lemma 

4.4. 

Let  <t> 

€  $  .  Then  there 

exists 

c  such  that 

(a) 

e  c 

m+2 

(-*),  M^u*Mm+2  5 

c  for 

all  u  €  flr  . 

(b) 

The 

mapping 

(u,u)  -V  ^U<t>(p) 

is  continuous  from 

X 

J. 

r 

into  1R1  for  every 

r  <  00 . 

This  follows  at  once  from  (4.7). 

Let  us  next  apply  the  Ito  differential  rule  to  ^(A^);  for 

<p  e  9m, 
m 


<P(A^)  =  F(<f^,A^.;>,...><  f  j  ,  A  ^  > )  . 


We  get,  using  the  Zakai  equation  (3.1), 


(4.8) 


d0(A 


U.  J 

)  =  ^  t<i>  (A  )dt  +  I  F  (...)<hf.,A  >*dY  , 
t  t  j=i  zj  J 


whe 


re  ...  denotes  (<f ^ , A^> , . . . , <f j , At>) .  Since 


| F  |  <  C(l+|z|m+1),  the  components  of  F,  (< f^ ,u> ,...,< f j ,U >) <h f • ,u > 

j  J 

are  in  C  From  3.4,  the  integral  on  [0,t]  of  the  last 

term  in  (4.8)  is  a  square  integrable  u ,  {  }  martingale  for 

any  n  €  2# .  By  taking  E_  in  (4.8)  and  using  Lemma  4.4(a) 

Jo 

we  get 


rt  ue 

Eir1>(At)  =  <P(W)  +  Ev  Jo  &  °4>(A0)d9, 


(4.9) 


for  any  <i>  £  ^  ,  11  £  stf,  and  any  initial  data  u  =  Ag. 


Lemma  4.5.  Let  t  0  <  s  <  t  <  T.  Then  there  exists 

u  (depending  on  Y  and  T)  such  that 


I  l-^t  *  '  -?sV|,*+2  - 


Proof.  Consider  any  w  £  -a*'.  By  (4.9) 


r  t  Un 

|  Ew4>  (A  )  -  E^(A  )|  <  E  \y  <t>  (Ag)  I  d© 

*  S 

t 


<  max  |  |  Jzfu<p  |  | 
u€^ 


m+2 


d  +  E|  |AJ  |m+Z)d9 


By  Lemma  4.4a  and  3.4 


|Eff*(At)  -  Eff<KAs)|  <  c(l  +  Ym+2>T)(t-s)(l+|  |y||m+2) 


Since  this  holds  for  all  n  £  srf,  we  get  Lemma  4.5  with 
a  =  c(l+Ym+2>T). 


Proof  of  Theorem  4.2.  For  some  K,  <P  €  .  By  Lemma  2.4 

there  exists  n  =  1,2,...,  such  that  I  I I  I K  *s  b°unded 

and  d('Pn,<t>)  0.  Fix  T  >  0.  For  0  <  s  <  t  <  T,  we  write 


sr^  - 


^  - 


Cy  M  I 

t  nJ 


t  n 


</  'I'  ] 

-ysrnJ 


+  [ 


C/r^ 

s  n 


Lemma  3.5  implies  that  the  first  and  third  terms  on  the  right  side 
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tend  to  0  as  n  -*•  °°,  uniformly  for  0  <  s  <  t  <  T  and  p  €  . 

Lemma  4.5  with  m  =  0  implies,  for  u  €  , 

I  -VnOO  -  >s^n(u)|  <  un(l  +  r2)(t-s) 

where  is  some  constant.  Let 

n(e,r)  =  sup{  |  J /^(u)  -  >s<P(u)|:  u  £  ^r,0<s<t<T,  t-s<e}. 

For  each  r,  n(e,r)  -*•  0  as  e  0 .  This  implies  d(  y^<P  ,  j^<j>)  0 

as  t  -  s  •+•  0 ,  as  required. 

This  proves  Theorem  4.2. 


Constant  controls.  In  particular,  let  us  consider  a  constant 

control  u.  In  our  formulation,  this  corresponds  to  taking 

7T  =  ttu  =  w  x  $ ,  where  w  is  Wiener  measure  on  C([0,°°);  ]Rm) 

2 

and  6  is  the  Dirac  measure  on  L.  ([0,'°):^')  concentrated  on 
u  loc 

the  constant  trajectory  U  s  u.  We  can  then  write  E(=  E  ) 

L  W 

instead  of  E  ,  and  obtain  from 
iru 


(4.10)  E4>  ( A t )  =  *(y)  +  E  J  ^U«KAQ)d0,  <P  e  &m. 


For  constant  u,  we  may  regard  A  as  defined  on  the  sample 

N 

space  C([0,°°);  1R  )  of  Y-traj ectories  ,  endowed  with  the  family 

{  ^.(Y)}  of  o-algebras  and  with  Wiener  measure  w.  It  follows  from 

Y  u 

Lemma  4.2  that  A^  =  A  is  a  Markov  process  (u  fixed),  with 
which  is  associated  the  linear  semigroup  on 


I 


-31  - 


(4.11)  00  =  El  (At), 

where  E  =  E  . 

w 

From  (4.10]  we  have,  for  <t>  €  Z&  9 

(4.12)  t'^Hpfy)  -  4. (Vi)  -  tiAoi))  =  t'1  j*Li^(i/u  )(y)  -^(y)]d9. 

Since  yu<P  £  C(jt)  the  same  proof  as  for  Theorem  4.2  shows  that 
J/~Q(Jzfu<P)  -*■  yu<p  as  9  -*■  0+,  uniformly  on  for  each 

r  <  00  (alternatively  we  could  apply  Theorem  4.2  with  the  control 
space  replaced  by  a  new  one-element  control  space  {u}.)  Hence 

the  left  side  of  (4.12)  tends  to  0  as  t  0+  uniformly  on 
which  implies 

(4.13)  =  d-lim  t"1[^<J'-<P|  ,  *  €  . 

t->-0  + 

This  shows  that  for  each  m  *  0,1,2,...,  is  contained  in  the 

domain  of  the  generator  of  the  linear  semigroup  and  that  i^u 

agrees  on  with  the  generator. 

5.  The  Generator  of  the  Semigroup  .  We  define  the  operator 
y  on  the  dense  subset  y  of  C(jt)  by 

(5.1)  Wp)  =  min  ^u$(y),  9  £  0. 

ue^ 

Lemma  4.4  implies  that  iA>  €  for  every  €  ty. 


We  need  slightly  stronger  hypotheses  on  o,b^,b*  than  ( A  ^  J , 

( A 7 )  in  §  3 : 

,2 

(Aj)  Condition  (Ap  holds  and,  in  addition,  a  €  C^QRN;BN  ), 
where  a  =  oo'. 

(Ap  b(x,u)  =  b^(x)  +  b^(x)u,  where  b^  £  C^GR^dR^)  and 

,1  r2nDNmNL. 
b  £  (1R  -JR  )  . 

When  (Ap,  (Ap  ,  (Ap  hold,  f  £  c”0RN)  implies  LUf  £  Cq(IRN) 
and  hf  €  CqQRN;KM).  From  (4.7),  $  £  <J  implies  yu<l>  €  Q?2. 

Theorem  5.1.  For  every  4>  € 

(5.2)  yt  =  d-lim  t'l( 

t-0*  c 

This  theorem  justifies  our  calling  ¥  the  generator  of  the 
nonlinear  semigroup  Our  proof  of  Theorem  5.1  follows  the 

same  general  line  of  reasoning  as  Nisio  [6], 

The  proof  of  Theorem  5.1  depends  on  the  following  estimates 
for  the  semigroups  for  any  constant  control  u  £  .  By  the 

same  calculation  used  in  the  proof  of  Theorem  3.1 

(5.3)  |  |y^|  |K  5  (1+YKt)l  1*1  lK»  ♦  6  cKu). 

For  <)>  €  2#  ,  3.4  and  (4.10)  imply 


)t 


(5.4) 
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Lemma  4.4(a)  gives  a  bound  for  \\y  <J>  |  |  m  +  2 . 
Now  consider  <j>  £ 


$00  =  F(<f1,u>,  .  .  .  ,<fj,U>) 


With  F  £  c“qrJ),  f.  £  c“(IRN).  Then 

J 


y  $  =  - 1  <p  +  i  <t> 

j=i  3  j,k=i  3k 


^j(M)  =  Fz  (<f1,M>,...,<fJ,M>)<LUfj,p> 

$jk(P)  =  Fz  .  zk(<fl.*P>’  •  •  '  ,<fj,h>)<hfj  ,n>-<hfk,u> 


-  4>  -  ty  u<p  = 


-  yu<t>  ]  d^ 


=  l 
j  ' 


'V*j  -  ♦j!'1-  *  |k  frV'jk  -  V 


]d« 


Since  ,$jk  6  we  can  apply  (5.4)  to  to  get,  for 

0  <  t  <  1, 

(s.5)  I  \yutP  -  $  -  t¥u<p  1 1 4  <  et 2 

where  the  constant  3  depends  on  4>  but  not  on  u  £ 


Lemma  5.1.  For  <P  £  & 


J/t<p  -  <p  >  j1  yQ  ( j*f<j>)d3 


Proof.  By  (4.9),  for  any  11  £ 


E„9  (At )  -  <P(U) 


ft  U0 

y  4>(A0)d0 

0 


>  E. 


^♦(Ae)d0  - 


ft 


En  JS<P(  AQ)dO 


d9 


The  minimum  over  ja/  of  the  left  side  is  T  <i>  (y )  -  <j>  (y )  .  This 
proves  Lemma  5.1. 


Proof  of  Theorem  5.1.  Observe  that  j^<f>  <  9  ^  for  all 

u  £  °k  (constant  controls  are  suboptimal)  Then,  for  4>  €  , 

0  <  t  <  1, 

t_1[  -  0  -  t¥u$]  <  t'l[^  -  ♦  - 


In  particular,  given  y  we  take  u  such  that  Jzfu<P  (y)  =  (v) 

[recall  (5.1)].  By  (5.5),  when  0  <  t  <  1, 


t'1  [  yt<P  (y)  -  <Km)  -  ti/4>(y)]  <  Bt  (1+|  |y  |  |4). 

Therefore,  uniformly  for  y  £ 

lim  sup  t'1[  -  <f»(y)]  <  i^>(y). 

t-0  + 

On  the  other  hand,  by  Lemma  5.1 


-35- 

-  1  .  i  ft 

lim  inf  t  [  _y  9(u)  -  (P  3  ]  >  lim  inf  t  {-/'ty )  (p  )  do  . 

c->0+  1  t+O  Jo 

Since  y  <P  €  C{JL)  ,  Theorem  4.2  implies  that  ^  (y<P )  (p )  -*■  izf4(p) 
as  a  -*■  0+»  uniformly  on  Hence, 

lim  t’1  [  J/<t>  (w )  -  9(h))  -  <SH\i) 
t-*0  r 

uniformly  on  _^r,  fo.r  each  r.  This  proves  Theorem  5.1. 


Remark.  The  nonlinear  semigroup  5^  can  be  obtained  from 

the  family  of  linear  semigroups  u  £  by  the  following 

procedure  used  in  [6].  For  A  >  0,  let  ^<1>(p)  =  min  J/^fp). 

uE'Sr 

For  n  =  1,2,...  and  dyadic  rational  t  =  m2  n  (m  =  1,2,...)  let 


^  =  /J*  -  An  =  2’n«  ♦  € 

n 

It  is  easy  to  show  that,  for  dyadic  rational  t  =  m2  n. 

>  ...  >  sr^. 

By  considering  controls  piecewise  constant  in  time,  one  can  show 
that  S? ^  -*■  J^.41  as  n  ->  ®,  if  t  is  dyadic  rational.  Choose 

n  large  enough  such  that  t  =  m2’n.  Let  x^  =  k2n  and 


-a'nt  "  e  a^t:  W[UT  =  UT  for  x  £  k  =  0,l,...,m-l]  =  1}. 

k 


By  induction  on  m  (for  fixed  n)  and  a  construction  like  that  in 
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thc  proof  of  Theorem  4.1,  it  can  be  shown  that 

=  min  J(t,ii,tf  ,<i>). 

By  [ 3 ,  Corollary  6.1],  every  ^  £  jV  is  the  limit  of  n  as 

t  nt 

n  -*■  00 ,  with  T*  £  .  Lemma  3.6  then  implies  that 

^^(M)  -*•  as  n  -*•  00 . 
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